32455US02 



A Meth d of and a System for Surveillance of an Environment Utilising 
Electromagnetic Waves 

Field of the Invention 

5 The present invention relates to a method of and system for surveillance of a physical 

environment. More particularly, the present invention relates to a method of and system for 
surveillance of a physical environment using electromagnetic waves. The physical environment 
considered is typically around and inside buildings, open places, open air areas and the like, but 
might also be concentrated local volumes, e.g. a part of an indoor room. The environment is 

10 typically composed of electrically conducting and non-conducting solid construction materials, 
e.g. iron reinforced concrete and wood, and biological construction materials which constitutes 
e.g. human beings, animals, trees, but it might also be empty. Furthermore, the physical 
environment may contain materials in a liquid state, e.g. water. A general concept of preferred 
embodiments of the present invention relates to surveillance of a physical environment by 

15 measuring changes in the propagation properties of electromagnetic waves through the 
environment. 

Background of the Invention 

US 4,476,459 discloses a system comprising a transmitter antenna and a receiver antenna 
20 mounted within an interrogation zone, formed by the space around the said transmitter and 
receiver antennas. This transmitter, receiver system is used for detecting the passage of a 
resonant circuit, through the interrogation zone, by using the following function sequence: 

1. The transmitter delivers a short electromagnetic pulse to the interrogation zone. 

2. If a resonant circuit is present in the interrogation zone, it receives an electromagnetic 
25 energy pulse from the transmitter. 

3. Having received the said electromagnetic energy pulse, the resonant circuit resonate at 
its resonance frequency and thereby transmits energy to the interrogation zone receiver 
antenna. The signal transmitted from the resonant circuit is decaying in time, and this 
time decay is used in the receiver for detecting the presence of a resonant circuit, and 

30 reduce the number of erroneous detections, which might originate in the electro- 

magnetic noise from the environment. 

EP 0 743 540 A2 discloses a system being adapted to detect the presence of foreign objects 
inside a robbery-prevention security antechamber, e.g. commonly used in banks. The 

35 antechamber consists of a plurality of radiofrequency emitting elements, associated with a 
plurality of receiving units. The six walls of the antechamber are preferably made from 
electrically conducting materials, which can reflect microwaves in the range of 10 GHz. The 
antechamber is considered as a resonant cavity, where the distribution of the electromagnetic 
field depends on the geometric dimensions of the cavity (the antechamber) and the materials in 

40 the cavity. A modification of the situation in the antechamber, e.g. by the passage of a person, 
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will change the distribution of the standing wave electromagnetic field. The modification can be 
detected by analyzing the standing wave electromagnetic field before passage of a person and 
compare it to the field after passage of a person. The transmitters and receivers are positioned 
in a two dimensional grid in alternating grid points in the ceiling. An important feature of the 
5 transmitters is that they have a sufficient spectral purity, to obtain stable standing wave 
analysis. The measurement of the standing wave field in the antechamber is carried out by 
enabling the transmitters one-by-one, and carry out a simultaneous recording of the field using 
all receivers. These measurements are then compared to what is obtained when a person 
passes the chamber using the same said measuring procedure, and thereby a detection of a 
10 foreign object in the antechamber is obtained. 

US 6,288,640 Bl discloses a system comprising a plurality of sensors and a corresponding 
plurality of receivers. The sensors receive an FM signal broadcast by a transmitter, 
preferably a commercial FM radio station. Each receiver receives, via the associated 

15 sensor, radio frequency signals comprising a multiplicity of transmissions at different 
frequencies, within a predefined frequency spectrum. The receiver detects the radio 
frequency signals and computes, for each of a plurality of successive time intervals and for 
each of the transmission frequencies, a measurement of the signal amplitude over the 
time interval, compares the signal amplitude measurement with at least one threshold 

20 and, if the threshold is exceeded, generates a potential alarm signal. An alarm signal 
might be generated if a preset number of a multiplicity of the transmission frequencies 
have detected an alarm. No comparison between two independently transmitted and 
received signals is performed. 

25 Summary of the Invention 

It is an object of the present invention to provide a surveillance system which is simple to 
implement and use. 

It is a further object of the present invention to provide a surveillance system which is 
30 capable of utilising installations which are already present for other purposes. 

It is an even further object of the present invention to provide a surveillance system which 
does not require high spectral purity of the transmitted signals. 

35 It is an even further object of the present invention to provide a surveillance system which 
is dynamical in use. 



40 



It is an even further object of the present invention to provide a surveillance system which 
does not require heavy computations in order to determine whether a change has 
occurred. 
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It is an even further object of the present invention to provide a surveillance method using 
a surveillance system having the advantages outlined above. 

5 According to a first aspect of the present invention the above and other objects are fulfilled 
by providing a surveillance system comprising at least one transmitter, each being adapted 
to transmit a signal, and at least one receiver, each being adapted to receive a signal, said 
system being further adapted to: 

10 - transmit a first signal by use of one of the at least one transmitters, 

transmit a second signal, succeeding the first signal, by use of one of the at least one 
transmitters, 

receive said first signal by use of one of the at least one receivers, 
receive said second signal by use of one of the at least one receivers, 

15 

the system further comprising means for comparing the received first signal and the 
received second signal in order to detect a difference, if present, in said two signals, said 
difference being caused by a physical change present in the signal path between at least 
one of the transmitting transmitters and at least one of the receiving receivers, said 
20 change occurring between initiation of transmittal of the first signal and termination of the 
receipt of the second signal. 

According to a second aspect of the present invention the above and other objects are 
fulfilled by providing a surveillance method, the method utilising at least one transmitter, 
25 each being adapted to transmit a signal, and at least one receiver, each being adapted to 
receive a signal, the method comprising the steps of: 

transmitting a first signal by use of one of the at least? one transmitters, 
transmitting a second signal, succeeding the first signal, by use of one of the at least 

30 one transmitters, 

receiving said first signal by use of one of the at least one receivers, 

receiving said second signal by use of one of the at least one receivers, 

comparing the received first signal and the received second signal in order to detect a 

difference, if present, in said two signals, said difference being caused by a physical 

35 change present in the signal path between at least one of the transmitting transmitters 
and at least one of the receiving receivers, said change occurring between initiation of 
transmittal of the first signal and termination of the receipt of the second signal. 
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In the present context, the term 'succeeding the first signal' should be understood in such 
a way that the first transmitted signal and the second transmitted signal are temporally 
separated in such a way that the first signal is transmitted before the second signal is 
transmitted. 

5 

The physical change is an actual change which has taken place in the physical environment 
which is subject to the surveillance. It may, e.g., be a person moving through a room, 
switching on/off of light, heat, air condition, water, etc., opening/closing of a door or a 
window, and/or any other physical change in the environment. In particular, in case the 
10 physical change is a person moving through a room, this may indicate that an intruder has 
entered the room, and an alarm may therefore be activated. Alternatively, in case light, 
heat, air condition, water, etc. has been switched on/off, this might indicate a failure in the 
corresponding system, and a suitable alarm may be activated. 

15 In case a difference is not detected between the two signals, this indicates that no physical 
change is present. The method steps are then, preferably, repeated until a change is 
detected and appropriate actions are taken. 

The signal path between at least one of the transmitters and at least one of the receivers 
20 may be the line of sight, if possible, between said transmitter and said receiver. 
Alternatively or additionally, the signal path may be a path comprising one or more 
reflections of the signal and/or one or more refractions of the signal. In any case it is to be 
understood as the actual path travelled by the signal from the transmitter transmitting the 
signal to the receiver receiving the signal. 

25 

The change should occur between initiation of transmittal of the first signal and 
termination of the receipt of the second signal, i.e. during the time in which at least one of 
the signals is under way from a transmitter to a receiver. That is, a physical change may 
be discovered if it takes place while a 'measurement* is performed. 

30 

The first and second signals may be transmitted from the same transmitter. Alternatively, 
two different transmitters may transmit the first and the second signals. 

Similarly, the first and second signals may be received by the same receiver, or by two 
35 different receivers. 

In one embodiment the first and second signals may be transmitted by the same 
transmitter, but received by two different receivers. In another embodiment the first and 
second signals may be transmitted by two different transmitters, but received by the same 
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receiver. Alternatively, the two signals may be transmitted by the same transmitter and 
received by the same receiver, or they may be transmitted by two different transmitters 
and received by two different receivers. 

5 The comparing means may be adapted to detect a difference in signal strength between 
the first received signal and the second received signal. Alternatively or additionally, other 
signal parameters may be compared, such as frequency, polarization, delay, and/or any 
other suitable signal parameter. 

10 In one embodiment of the present invention the comparing means may comprise 

processing means for processing the first and/or the second received signal(s) before 
comparing them, the comparison being performed on the basis of the processed signals. 

In this embodiment the comparison is performed on one or more quantities derived from 
15 the signals. Alternatively or additionally, the comparison may be performed on a function 
of the first and second received signals. Alternatively to this embodiment, the comparison 
may be performed directly between the two signals in the time domain, or in the frequency 
domain, e.g. by spectral subtraction, or by similar methods. 

20 The first signal may be transmitted during a pre-selected first time window and the second 
signal may be transmitted during a pre-selected second time window. The first and second 
time windows may have equal durations. Alternatively, the durations of the two time 
windows may be different. 

25 Each of the signals transmitted may be a constant signal, such as a carrier wave or a 
carrier wave like. Alternatively, they may be known impulses or impulse like signals. 

Preferably, the transmitted signals are electromagnetic signals, such as light signals, radio 
frequency (RF) signals, infrared (IR) signals, etc. Alternatively, the signals may be of any 
30 other suitable kind, such as acoustic signals, electrical signals, a beam of particles, or any 
other suitable kind of signal. 

The first and the second signals may be transmitted as a first and a second set of packets 
of electromagnetic radiation, in which case the receiver(s) receive the first and second sets 
35 of packets. In the present context the term 'packet' is to be understood as an indivisible 
unit of information transfer between transmitter and receiver. 

The comparing means may be adapted to compare the statistics on the signal strength of 
each packet to identify differences between the energy contents of the first and the second 
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set of packets. Alternatively or additionally, other signal parameters of the packets may be 
compared, such as spectrum, polarization and/or delay. 

In a preferred embodiment, the transmitter(s) and the receiver(s) may be components of 
5 a wireless network used for data transmission and/or positioning, such as a wireless local 
area network (WLAN) used for data transmission and/or positioning. In this embodiment a 
wireless network which is already installed in a specific area for the purpose of providing 
wireless data transmission possibilities, may be used for surveillance purposes. This is a 
great advantage, because the surveillance system in this embodiment does not require 
10 separate installations. It is therefore very easy and very cost effective to provide a 
surveillance system according to this embodiment. 

In one embodiment at least one transmitter and at least one receiver may be combined 
into a transceiver. All the transmitters/receivers of the system may pair-wise be combined 
15 into transceivers, in which case all 'units' of the system may function as a transmitter as 
well as a receiver. This embodiment provides a system of great flexibility. 

The comparing means may be adapted to compare the detected difference to at least one 
known value, so as to identify the physical change causing the difference. In this 

20 embodiment the known value(s) may represent various known physical changes. The 
physical changes may previously have been 'detected' under controlled circumstances in 
order to establish a 'reference' or a number of 'references'. When the surveillance system 
is operating, it is thus possible to compare the obtained results with this/these 
reference(s). In case the obtained results match the reference/one of the references, the 

25 nature of the physical change may, thus, be determined. Thus, in case it is determined 
that the physical change is due to a person moving through the room, an intruder alarm 
may be activated, while the intruder alarm is not activated in case it is determined that the 
physical change is due to a heater being turned on or off. 

30 The system may further comprise means for collecting and storing previously obtained 
information relating to a plurality of compared signals, and means for comparing said 
information in order to allow for evaluation of a temporal development of the obtained 
information. In this embodiment a long term surveillance of the volume of interest is 
provided for. When information relating to the compared signals are stored, it is possible 

35 to monitor how the signals develop over time. This may, e.g., be used for adjusting a 

'reference' as described above, or may be used for detecting changes in the volume, e.g. a 
gradual change of water contents. 



32455US02 



* " 7 

The system may further comprise means for determining the position of physical changes 
in the volume of interest. In this embodiment it is not just detected that a physical change 
has occurred, but also the position in which this change has occurred. This may be 
important in order to determine which actions to perform in case a physical change is 
5 detected. In this embodiment it is necessary to have a physical model of the volume of 
interest. The 'position information' (e.g. originating from transmitted/received signals 
which have been reflected, refracted or damped by an object which has entered the 
volume of interest) may then be combined with the physical model in order to establish 
the position of the physical change. 

10 

Brief Description of the Drawings 

The present invention, and in particular preferred embodiments thereof, will now be presented 
in connection with the accompanying drawing, in which 

15 Fig. 1 shows an environment according to a preferred embodiment of the present invention, the 
environment comprising a room with four walls, a floor and a ceiling, and 

Fig. 2 shows an environment according to another preferred embodiment of the present 
invention, the environment comprising three levels of a building, a ground level, first level and 
20 second level. 

Detailed Description of the Drawings 

An overall concept of preferred embodiments according to the present invention is indicated in 
Fig. 1 which shows a room being configured with a wireless local area network (WLAN) having 
25 transceivers, i.e. a device comprising a transmitter (TX) for transmitting and receiver (RX) for 
receiving electromagnetic radiation. The transceivers 1 constitute access points (AP) in the 
WLAN. 

Fig. 1 shows a room with four walls, a floor and a ceiling/Inside the room there is a table, a 
30 computer 2 and a chair. Some of the major construction elements of the chair are assumed to 
be metallic. At the midpoint between the two upper left corners of the room, is positioned a 
Wireless Local Area Network (WLAN) Access Point (AP) 1. Furthermore, an AP 1 is positioned at 
the midpoint of the nearest left wall, and in the rightmost corner, a short distance above the 
floor. The WLAN is designed such that the APs 1 can communicate, and furthermore the 
35 computer 2, also denoted a client, can communicate with one or more of the APs 1. It is to be 
understood that the APs 1 can be placed in many different ways, and the above is an example. 

Within the room a computer 2, also denoted a client, is present, which computer 2 comprises a 
transceiver enabling data communication with a server via the transceivers 1. Furthermore, 
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three transceivers 1 and thereby three access points (AP) are present in the room as shown in 
Fig. 1. 

It is noted that the WLAN is preferably of the known and ordinary type, but it is contemplated 
5 that transmitters, receivers of the Bluetooth type or the like technology or transceivers 
dedicated surveillance purposes may be applied in connection with the present invention. 

When the WLAN is used for surveillance in accordance with the present invention, the WLAN is 
operated in two different modes: Mode 1 and Mode 2. 

10 

Initially one of several Mode 1 and Mode 2 regimes is described. 

In Mode 1, a set of packets is transmitted from a transceiver 1. The number of packets in the 
set are preferably transmitted during a time window having a predetermined length, T x seconds. 

15 It is contemplated that the packets contain information on the transmitted signal parameters 
(e.g. signal strength, polarization, spectrum, etc.). Upon receipt of the packets by the 
transceiver 1, the strength, and/or other signal parameters, of each packet is detected, 
recorded and stored, possibly together with the information on the signal strength, or the signal 
parameters, by which each packet was transmitted, thereby establishing a Mode 1 vector 

20 comprising, for each package in the set, the transmitted and the received signal strengths or 
the signal parameters. Thus the Mode 1 establishes a reference model. 

Following this Mode 1, which may be characterised as determining a reference for comparison, 
Mode 2 is carried out. Basically the same steps as performed in Mode 1 are carried out, i.e. 
25 transmitting a set of packets and receiving, detecting and recording the strengths, or the signal 
parameters, whereby a Mode 2 vector is established comprising, for each packet in the set, the 
transmitted strength, and/or other signal parameters and the received strength, or the signal 
parameters. Thus the Mode 2 establishes the current model. 

30 The Mode 1 and Mode 2 might be defined within a selection of regimes defined by the 

movement of Mode 1 and Mode 2 time windows. In the following are given three examples of 
regimes, but many alternative regimes are possible. 

Assume the following: 

35 

n: A counter assuming the values n= 0,1,2,... For each increment of n, a test is carried out 
between the reference model and the current model, to detect if en event has happened. 
Ml: The number of packets transmitted in the Mode 1 window. 
M2: The number of packets transmitted in the Mode 2 window. 
40 ml(n): The highest packet number in the Mode 1 window, with counter n. 
m2(n): The highest packet number in the Mode 2 window, with counter n. 
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dml: The number of packets the Mode 1 window is moved, when incrementing n by 1. 
dm2: The number of packets, the Mode 2 window is moved, when incrementing n by 1. 
Then the time instances t n of the Mode 1 and Mode 2 windows packets, are determined as 
follows: 

5 

Initialize: ml(-l) = Ml and m2(-l) = Ml+M2. 

Begin for n=0,l,2,... Counter for comparing the reference model and the current model. 
ml(n)=ml(n-l) + dml x n 

The time instances of the Mode 1 window packets, used in the Mode 1 model, are: 

10 tml-Ml + 1 < •■■ < t m i 

m2(n) = m2(n-l) + dm2 x n 

The time instances of the Mode 2 window packets, used in the Mode 2 model, are: 

T m 2-M2+1 < . . < t m2 

15 Endfor n 

Then the following regimes are obtained, by selecting the corresponding parameter values. 

• A fixed Mode 1 window and block movement of the Mode 2 window is obtained by: 
M1>0, M2>0, dml=0> dm2=M2. 

20 • A block movement of the Mode 1 window and block movement of the Mode 2 
window is obtained by: M1>0, M2>0, dml = Ml, dm2=M2. 

• A sliding movement of the Mode 1 window and single packet movement of the 
Mode 2 window is obtained by: M1>0, M2=l, dml = l, dm2=l. The Mode 2 window 
consists of just one packet. 

25 

It is noted, that in a WLAN operated to continuously transmit packets, the sets considered 
above may be defined by only recording information on the strengths, and/or the other signal 
parameters in the given time windows. 

30 The information contained in the Mode 1 and Mode 2 vectors is now analysed to identify any 
significant difference between them. If a significant difference is identified, this is an indication 
that an event influencing the transmission of electromagnetic radiation occurred after Mode 1 
was initiated and before Mode 2 was completed. 

35 Another advantageous effect of the present invention may be obtained by tuning the system to 
identify specific events. This is done by analysing the effect a known event has on the Mode 2 
vector and storing this information for later on the fly comparison for identification. 

Furthermore, one could easily consider to embody the system in a manner where the Mode 1 
40 vector is obtained in advance and under predetermined known conditions whereby any 
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difference to such known conditions would be reflected in the Mode 2 vector. Furthermore, 
there is referred to the selection of the regimes of Mode 1 and Mode 2 windows. 

Furthermore, the invention may also be embodied as a system utilising detection of changes in 
5 a carrier wave like signal, that is transmission of a continuous wave by one of the transmitters. 
Alternatively the invention may also be embodied as a system utilizing detection of changes in 
the transmission of short time impulses. In such systems, the receiver detects, in Mode 1, the 
signal in a first time window and performs for instance an integration over time of the received 
signal or estimated signal parameter properties (e.g. signal strength, polarization, spectrum, 
10 etc.). In Mode 2, the same procedure is applied and the signal is integrated or the signal 

parameter properties (e.g. signal strength, polarization, spectrum, etc.) are estimated. The two 
integrated signals or the signal parameter properties are then compared to each other and if a 
difference is found, an indication of a change in the volume of interest is detected. 

15 The transceivers 1 are connected via wires to a server. Alternatively they might connect 
wirelessly to the server. The purpose of the server is to control the transceivers 1 and to 
perform the data-processing. The data-processing comprises outputting to the transceivers 1 
information on which signal to be transmitted and perform the comparison of the signals 
received, from transceivers 1 which are access points or transceiver 2 which is a client, during 

20 Mode 1 and Mode 2. It should, however, by noted that the data-processing may be made an 
integral part of the functioning of the transceivers 1 and 2. 

Considering the above, the invention may in general be seen to be represented by the following 
items: 

25 

A 3D physical environment of interest which in the following is denoted Volume of Interest 
(VOI). The physical material in VOI, if any, is represented by the spatial position dependence of 
the constitutive relations of the Maxwell equations, where the physical material is characterized 
by the material parameters permittivity e, permeability \x and conductivity a. One such example 
30 may be: The VOI can be the interior of a house, including the nearest outdoor environment of 
the house. 

An event within the VOI is characterised by a change in one or more of the physical material 
parameters, within a finite time window. This means that e=e(spatial position, time), 
35 fi=^i(spatial position, time) and a=a(spatial position, time), where the spatial position is within 
the VOI. One such example may be: A person moves from one room in a house to another, by 
walking through the former room then opening a door and walking into the latter room and 
finally closing the door. 
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The position of an event is the spatial position of the changed material parameters within the 
VOL Examples may be: The instantaneous spatial position of a person, walking around in a 
house or the position of a door being opened. 

5 The surveillance or detection system components are denoted GE, TM, TX, RX and DT where: 
GE is a generator which delivers data sequences, to be transmitted by the 
electromagnetic wave transmitter TX. 

TM is the transmission mode: Either through an electromagnetic carrier frequency or 
electromagnetic impulses. 

10 - TX is an electromagnetic wave transmitter, working either at a carrier frequency f or by 

transmitting impulses. The transmitter is equipped with an antenna. 
RX is an electromagnetic wave receiver, receiving at the carrier frequency f or wide 
band if electromagnetic impulses are used. The receiver is equipped with an antenna. 
DT is a data sequence detector connected with RX. DT works in two modes. In Mode 1, 

15 a reference model estimated from the received signal strength or the said signal 

parameters at the carrier frequency or the received impulses of the propagation paths 
from TX to RX, is estimated. In Mode 2 it is tested, if the current signal strengths or the 
signal parameters received through the propagation paths, the current model, deviate 
from the reference model estimated in Mode 1. These models are based on methods 

20 available within the area of signal processing and statistics. 

Furthermore, the combination of GE and DT can work in four different function cases, denoted 
GE_DT_1 to GE_DT_4. They represents four different combinations of data communication 
and/or surveillance systems. The four cases are determined by the capabilities of the GE, 
25 having completely control of the communication mode and the data sequence (DS) transmitted 
or not; and the capability of DT to carry out feed-back to GE, dependent on the received DS, 
and its associated parameters, e.g. strength, polarization, spectrum. 



This leads to the following: 



30 



GE_DT_1: GE does not have completely control of the DS. DT does not have feed-back 
capability to GE, dependent on the received DS. 

This system carries out a combination of data communication and surveillance, 
without the option of adapting the surveillance function dependent on the result 
35 of the surveillance. 

GE_DT_2: GE does have completely control of the DS. DT does not have feed-back 
capability to GE, dependent on the received DS. 

This system has the option of dividing the communication resources among 
data communication and surveillance, without the option of adapting the 
40 surveillance function dependent on the result of the surveillance. 



32455US02 



10 



5 



GE_DT_3: 



GE_DT_4: 



GE does not have completely control of the DS. DT does have feed-back 
capability to GE, dependent on the received DS. 

This system carries out a combination of data communication and surveillance, 
with the option of adapting a part of the communication resources to surveil- 
lance, e.g. dependent on the result of the surveillance. 

GE does have completely control of the DS. DT does have feed-back capability 
to GE, dependent on the received DS. 

This system has the option of dividing the data communication into use for 
communication and surveillance, with the option of adapting the communication 
capacity, e.g. depending on the result of the surveillance. Thus this system can 
change function mode from a situation where nearly all the communication 
capacity is used for data communication into a situation where all the capacity 
is allocated for surveillance. 



15 Thus, a surveillance system may preferably comprise a volume of interest (VOI), in which a 
transmitter (TX) and a receiver (RX) are mounted in known spatial positions. One example of 
the operation of the surveillance system for event detection is as follows: In Mode 1, the 
detector DT estimates, through the time period T start to T stop =T start + T a , the received signal 
parameter statistics of the GE data sequence, e.g. signal strength, polarization, spectrum, etc., 

20 transmitted from TX to RX via electromagnetic wave propagation paths. Then at time T stop the 
detector is switched from Mode 1 to Mode 2, where deviation of the received signal statistics 
from that, estimated in Mode 1 is tested. If a deviation is found, then an event is detected 
within the VOI. 

25 A surveillance system is thus, preferably, represented by the quintuple { G E,TM ,TX, RX, DT} , 
where the said components are defined above. 

The propagation paths from TX to RX comprises two parts: The line of sight (LOS) propagation 
path, which is the shortest straight line path from TX to RX and the multipath (MP) propagation 
30 from TX to RX, where the electromagnetic waves have been reflected or refracted at least one 
time. It is noted that a design principle for TX, RX pairs, targeted for combining data 
communication and VOI surveillance, might be based on a principle of minimizing the influence 
of multipath for the communication part and maximizing the influence of multipath for the VOI 
surveillance part. 



A complete surveillance or detection system is then a covering of the volume of interest with a 
set of surveillance systems {GE,TM,TX,RX,DT> with known positions. They are in the following 
represented by {GE,j ,TM j/k ,TXj ,RX k ,DT m#k } where: 

i=l,2,...,NGj (the number of generators of transmitter j) 



35 



40 



j=l,2,...,N T (the number of transmitters) 
k=l,2,...,N R (the number of receivers) 
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m=l,2,...ND k (the number of detectors of receiver k). 
It is noted that each transmitter might have several generators; that the transmission mode 
might be dependent on the specific TX RX pair, and thus spatial dependent and that each 
receiver might have several detectors. 

5 

In the case where the transmission mode is based on a carrier frequency, the electromagnetic 
wave carrier frequency of TX is selected as a compromise between frequencies, which are 
sensitive to an event and frequencies which are technologically feasible. To obtain a shadow 
effect of a human being, also denoted a fade in the transmission from TX to RX, it is desirable 
10 with a carrier frequency not smaller than 1 GHz. Frequencies lower than 400 MHz mainly pass 
through the human body and frequencies higher than 3GHz are completely reflected by the 
human body. 

Any transmitter, receiver pair, where the receiver can determine the received signal strength of 
15 a known transmitted signal sequence with known strength, can embody the surveillance 
system. 

An example of a preferred embodiment of a surveillance system according to the present 
invention utilises a Wireless Local Area Network (WLAN), exemplified by [IEEE 802.11, 1997]. 
20 In the following, the definitions related to WLAN are based on that standard. 

The embodiment of the surveillance or detection system utilises the following WLAN elements: 
Access Point (AP) [IEEE 802.11, 1997] p. 3, comprising a transmitter AP-TX part and a 
receiver AP-TX part. 
25 - Channel (CH) [IEEE 802.11, 1997] p. 3. 

RXVECTOR parameters [IEEE 802.11, 1997] p. 181, with 

Received Signal Strength Indicator (RSSI), which is an optional parameter that has a 
value of 0 - RSSI max . This parameter is a measure by the PHY sublayer, of the energy 
observed at the antenna used to receive the current PPDU. The RSSI is measured 
30 between the beginning of the start frame delimiter (SFD) and the end of the PLCP 

header error check (HEC). Thus the energy measurement of RSSI is according to [IEEE 
802.11, 1997] p. 183, Fig. 70, and is defined by the SFD (16 bit) + PLW (12 bit) + PSF 
(4 bit) + HEC (16 bit), in total 48 bit. 

35 A surveillance or detection system is embodied as follows: 

GE=Data sequence generator of PPDU, embodied in the computer associated with 
AP! -TX. 

TX=APi -TX, mounted in a fixed, known position in VOL 

RX==AP 2 -RX, mounted in a fixed, known position in VOI or RX = Client - RX mounted in 

40 a 

fixed, known position. 
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DTsDetection algorithm embodied in the computer associated with the client. 
S!(t n )=Value of RSSI at time t n . 

The DT-algorithm performs the following steps, in the GE_DT_1 function case: 

5 

Mode 1: Acquisition of {S^tn)} during the time window T sta rtto T start +Ti, 

and switch at time T start +T X into Mode 2. 
Mode 2: Repeat 

Acquisition of {s s (t n )> during the time window T+TY 
10 Perform a Kolmogorov-Smirnov statistical test of identity of the empirical distribution 

function obtained during Mode 2 on {s s (t n )}, with the function obtained during 
the Mode 1 on {Sj(t n )} using a threshold TH. 

If the empirical distributions are different according to the said threshold TH 
then an event is detected. 
15 End Repeat. 

It is to be understood that many alternative detection functions and tests can be used. 

If the WLAN performs both standard data communication and surveillance, the compound 
20 system is denoted a Multimodal WLAN or a Multifunction WLAN. In general a network 
performing this function will be denoted a Multimodal Network. 

An improvement is the application of a Surveillance Anchoring Access Points (SAAP), positioned 
close to the floor in an indoor site and ordinary WLAN APs or fixed mounted WLAN clients placed 
25 in the usual positions. APs or fixed mounted WLAN clients might be used for SAAPs thus used 
solely for surveillance. 

Another improvement is to enhance the VOI sensitivity with respect to surveillance, by embed- 
ding light metal structures in the construction elements, which might be critical with respect to 
30 surveillance, such as doors. 

Fig. 2 shows an example with three levels of a building, a ground level, first level and second 
level. The building is in the usual way consisting of rooms, pathways, doors etc. The buildings 
three levels are covered by a combination of WLAN Access Points (APs) 1 (shown as squares) 

35 and WLAN clients 2 (shown as triangles), all mounted in fixed positions in the building. The APs 
1 might communicate with each other, and they are preferably connected through a fixed wired 
network using standard systems. The WLAN clients 2 communicate with those APs 1, which are 
within the communication range of the clients 2. The surveillance is carried out by detecting 
changes in the said received signal strengths or signal parameters (e.g. polarization, spectrum) 

40 between the clients 2 and APs 1 and between the APs 1. It is noted that AP 1 and clients 2 may 
communicate across different floors. 
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Localized Surveillance 

It is foreseen that the complete surveillance system may be extended into localized 
surveillance. The objective of localized surveillance is to combine data communication between 
5 transmitter, receiver pairs, with a priori physical model information of the volume of interest 
(VOI), into a determination of the approximate physical position of reflection changes, if any, 
for some of the major reflection points in the volume of interest. A change might e.g. be the 
opening and closing of a door, which contains metallic parts of a size sufficient for detecting its 
change of position. 

10 

It is assumed that the volume of interest (VOI) is covered by the complete surveillance system. 
It is furthermore assumed that the VOI is represented by a physical model, which describes the 
geometrical position of the materials within the VOI. If, e.g., the VOI contains a building, then 
the physical model might be represented by the computer aided information base, which is the 

15 blueprint of the building, describing the placement of all construction materials and the type of 
materials used. This model is in the following referred to as the physical model of the volume of 
interest. It is also assumed that the transmitters, belonging to the complete surveillance 
system, transmit a signal, known in advance to the receivers belonging to the complete 
surveillance system. A receiver can then determine the time instances in the received signal, 

20 where the transmitted signal is received along a path containing environment reflector, e.g. by 
using cross correlation between the known transmitted signal and the received signal. 
Assuming that the geometrical positions of the transmitters and receivers are known and fixed 
within the volume of interest, it is possible to compute the transmission delay from any 
transmitter to any receiver. Furthermore it is assumed that a receiver (RX) receives a signal 

25 from a transmitter (TX) along the shortest straight line joining them. This is the so-called line of 
sight (LOS). The signal received along the LOS, is the first signal received in the receiver. All 
other signals from the transmitter will arrive later to the receiver. The transmission time for a 
signal received along one of the paths with reflectors, assuming only one reflection on the path, 
is determined as the sum of the transmission time along LOS and the time difference between 

30 the received path signal and the LOS signal. This latter difference can be determined in the 

receiver, e.g. using cross correlation. Knowing the transmission time from a transmitter (TX) to 
a reflector belonging to the volume of interest and further to a receiver (RX), together with the 
known positions of the TX and RX, characterizes the rotational symmetrical ellipsoid surface on 
which the reflector is residing, for a given pair of transmitter and receiver. The focus points of 

35 the ellipsoid are the positions of the receiver and the transmitter, and the geometrical distance 
from a focus point to the surface of the rotational symmetrical ellipsoid and further to the other 
focus point, is the above transmission time from the transmitter to a reflector and further to a 
receiver multiplied by the speed of light. 

40 Assuming that the volume of interest contains only one reflector, then for each transmitter (TX) 
and receiver (RX) pair this reflector resides on the rotational symmetrical ellipsoid surface, 
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provided the reflector is within the range of the TX,RX pair. The position of the reflector is then 
found by solving for the coordinates in the 3D space of the intersections between the ellipsoids 
obtained from all TX,RX pairs in the VOL 

5 Now, assuming that the volume of interest contains a composite physical object, e.g. a 
building, represented by the physical model, then the positions of the major reflectors are 
determined as follows. It is assumed that all physical objects are stationary, which means 
that no reflectors are changing position within the volume of interest. Then the positions of 
the transmitter, receiver pairs, together with the cross correlation of the transmitted and 
10 received signals and the physical model of the volume of interest, are used for a 
combination of combinatorial search and numerical optimization for determining the 
reflection points positions. 

A more detailed description of Localized Surveillance is made in the following. 

15 

It is assumed that the volume of interest (VOI) is covered by a complete surveillance system as 
follows: 

- Set of transmitters TXj where j = l,2,...,N T . N T isthe number of transmitters. 
20 - Positions of transmitters within the VOI 

pt j =(ptx j/ pty j ,ptZj), where j = l,2,...,N T . 

- Set of receivers RX if where i=l,2,...,N R . N R is the number of receivers. 

- Positions of receivers within the VOI 

pri=(prx, ,pry, , prz, ), where i = l,2,...,N R . 
25 - D iti is the geometrical distance between the receiver RXj and transmitter TXj , where 
i = l,2,...,N R and j-l,2,...,N T . 

c is the speed of light in meter/second. 

30 r itj (k) is the cross correlation between the signal transmitted from transmitter TXj and the signal 
received in receiver RX,, where k is the lag of the cross correlation. 

The time increment of the cross correlation function, corresponding to an increment of the lag k 
by 1 corresponds to an increment of T seconds. 

35 

The lowest value of k=ko , where |r u (k)| > w nolse and where w nolse is a noise threshold, is the 
time delay corresponding to receiving the signal along the line of sight (LOS) path from the 
transmitter (TXj) to the receiver (RX,), assuming that communication along LOS is possible. 
A value of k=k n and k n >ko where |r,j (k n )| > w n0 | Se corresponds to one or more multipath 
40 propagation delay from the transmitter TXj to reflector in the VOI and further to the receiver 
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RX, . The geometrical length of this path, L j#j , is determined by U fJ (m)=D } j + cT(k n - ko ) = D,j + 
dm, where d=cT is the spatial resolution of the receiver, and m = k n - ko . 

A path where |r u (k)| > w noise is said to belong to a major reflection point. 

5 

The rotational symmetrical ellipsoid surface, where a reflector is residing, determined by TXj and 
RX, , is denoted E,j (x,m)=0, where x=(x,y,z) is the independent spatial variables of the 
surface. 

10 Assuming that the volume of interest does only contain 1 reflector, and that there are used N T 
transmitters and N R receivers, then the position of the reflector r = (r x ,r y ,r 2 ) is found by solving 
the following nonlinear problem: 

r = arg (x) min XjZj [ E I(J (x,m)] 2 , where i=l,2,...,N R and j=l,2,...,N T and 
15 m is the cross correlation lag difference corresponding to the path in the respective 

cross correlation functions. 

Now, assuming that the volume of interest contains a composite physical object, e.g. a building, 
then the determination of the locations of the major reflection points are determined as follows. 
20 For each pair of TXj and RX, , the cross correlation between the received signal and the 

reference signal is determined as rjj(m), where m is defined above. Furthermore for each pair 
of TXj and RXj , it is possible to determine the positions of the major physical model reflectors of 
relevance to this pair, because the positions of TXjand RXj are known. 

25 A framework for identifying the positions of the major reflection points, is as follows: 

The positions of the reflectors might be found using a selection of methods. It is suggested to 
use a combination of combinatorial search on sets of reflections and numerical optimization to 
find the numerical values of the reflection positions. The search is controlled in combination by 
the reflections and the physical model of the volume of interest. For a stationary reflecting 

30 volume of interest, this solution might then be used repeatedly, for testing deviation from 
stationarity and the positions within volume of interest, where the deviations happens. 

It is to be understood that the cross correlation can be substituted with other methods for time 
delay estimation. 

35 

Long Term Analysis of Volume of Interest 

Furthermore it is foreseen to use a complete surveillance system for a volume of interest (VOI) 
for long term analysis of the VOI, using the fixed Mode 1 window and block movement of the 
Mode 2 window, under the assumption that the VOI physical model is unchanged. 



40 
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Using all measurements in the complete surveillance system fixed Mode 1 window in a model A 
and comparing to all the measurements in the complete surveillance system Mode 2 block 
moving window in a Model B can be used for detection of major changes in the material of the 
VOI, by comparing Model A and Model B. 

5 

Families of Surveillance Systems 

At least four families of surveillance systems are contemplated, which all might be preferably 
embodied by use of: Custom designed hardware, WLAN, Bluetooth or the like. 



10 


• 


Function: Event detection within the volume of interest (VOI). 




• 


Function: Event detection within the VOI and data communication. 




• 


Function: Event detection including positioning of the event within the VOL 




• 


Function: Event detection including positioning of the event within the VOI and data 






communication. 


15 








The Terminology Used in Connection with the Present Invention Comprises 




AP: 


Access Point of Wireless Local Area Network. 




DS: 


Data sequence. 


20 


DT: 


Detector. 




HEC: 


Header error check. 




PLCP: 


Physical Layer Convergence Protocol, [IEEE 802.11, 1997] p. 8. 




PLW: 


Length of PSDU. 




PPDU: 


PLCP Protocol Data Unit. 


25 


PSF: 


PLCP Signalling Field. 




PSDU: 


PLCP SDU. 




RSSI: 


Received Signal Strength Index. 




RX: 


Receiver. 




SAAP: 


Surveillance Anchoring Access Point of Wireless Local Area Network. 


30 


SDU: 


Service Data Unit. 




SFD: 


Start frame delimiter. 




TH: 


Threshold in Event Detector. 




TX: 


Transmitter. 




WLAN: 


Wireless Local Area Network. 


35 


e: 


permittivity, 






permeability 




a: 


conductivity 



The F Mowing References Referenced Herein 

40 [IEEE 802.11, 1997] is IEEE Std. 802.11-1997, Part 11: Wireless LAN Medium Access 
Control (MAC) and Physical Layer (PHY) Specification. 



